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(54) Abstract Title 

Synchronising databases in stacked network units 

(57) In a stack of multi-port network communication units each unit has a forwarding database, the units are 
connected by way of a cascade, and at least some of the units are connected to links constituting a trunk. 
When a unicast data packet is received at a first of said units and the unicast data packet has a destination 
address which is not the subject of an entry in the forwarding database of the first unit, the unicast data packet 
is sent by way of the cascade to the other units in the stack, accompanied by a flag. When a second unit has in 
its forwarding database an entry, associating the destination address with forwarding data, it sends a 
management packet indicating said destination address and the identity of said second unit, so that the 
database of the first unit can be immediately updated. 
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Replace the most significant 16 
bits of the Vlan Tag (8100) with 
the user defined information. 

Bit 31 is set to one to indicate 
the packet came in with a Vlan 
tag and so the last 16 bits are a 
valid tag. 

Bits 30-16 include the trunk ID. 
the source box ID and the 
unknown DA flag 

Bits 15-0 remain unchanged 
and contain the Vlan ID, CFI 
and Priority bits for the packet 
that was received. 



Insert 32 bits into the packet in 
the position that a Vlan tag 
would be inserted. 

Bit 31 is set to zero to indicate 
the packet did not come in with 
a Vlan tag 

Bits 30-16 include the trunk ID, 
the source box ID and the 
unknown DA flag 

Bits 15-0 would normally contain 
the Vlan ID, CFI and Priority bits 
for the packet that was received. 
The default settings are used 
but are ignored at the far end. 
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METHOD FOR SYNCHRONISING DATABASES IN STACKED NETWORK UNITS 
Field of the Invention 

5 This invention relates to the management of forwarding databases in a cascaded stack of 

network units, particularly multi-port switches, in a packet-based data communication system 
which employs addressed data packets The invention particularly relates to the reduction of 
unnecessary traffic flow constituted by the broadcast or 'flooding 7 of packets having 
unknown destination MAC (media access control) addresses. 

10 

Background to the Invention 

Packet-based data communication systems, such as Ethernet systems, commonly employ 
address data packets (otherwise called frames) which include source and destination media 

15 access control addresses as well as, usually, other type, control and address data, such as 

network address or IP address data. Data of this character normally precedes the payload or 
message data of a packet. The MAC address data in such a packet defines, in media access 
control or layer 2' terms, the dev ice from which a packet has come and to which a packet 
should be sent There are various forms of packet including multicast" packets, which have 

20 ' an address specifying a group of destination devices, and 'broadcast' packets, which should 
be sent to all possible destinations. Excessive broadcasting of packets is limited by the 
segmentation of a network into, for example, virtual local area networks, and it is common for 
packets to contain an identification of the virtual VLAN on which they originate 

25 Notwithstanding the variety of packets, the present invention will be particularly concerned 

with 'unicasf packets. If such a packet is received by a network unit, it is usually subject to a 
look-up in a database. Such a database, normally called 'forwarding database', contains 
destination addresses with forwarding data, such as port numbers, and other data. Different 
forms of forwarding databases, including those which can be looked up by means of media 
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access control addresses and network (IP) addresses are known. Various methods of look-up 
are also known in the literature. 

Broadly, a forwarding database may be compiled by reading the source MAC addresses of 
incoming data packets and, if such source address is not in the database the entry of that 
source address can be made together with irrelevant forwarding data, for example the port on 
which that packet was received. Then, when a packet is received having a destination address 
which matches an entry in the table, the packet can be sent to that destination address defined 
by the forwarding data in the data entry It is also known to add entries in such a database by 
means of management' frames, particularly when a network is initially set up. 

If a unit receives a packet which has an 'unknown" destination address, that is to say an 
address which is not the subject of an entry in the table, it is usual to 'flood' the packet, that is 
to say to send it to all the possible ports of the unit. This is a preliminary to an 'address 
resolution protocol' wherein when such a flooded packet is received from a device which has 
a network address corresponding to the address in the packet it will reply and the relevant 
destination address can be entered into the database for subsequent use in relation to packets 
intended for the destination. 

Stacked Units 

A feature of modern network practice is 'stacking' of units such as switches so as to form in 
effect a single entity. Switches which are similar or at least compatible may be connected 
together, as explained later, so that for example four switches having, for example, 24 pons 
each may behave as a single 96-port switch. The term 'stackable' is a conventional term in 
these circumstances. It is customary to stack the units physically one on top of the other but 
the term is intended to relate to the functional relationship between them. 



Cascades 



A group of stacked units requires a means of communication which is generally termed a 
'cascade' A cascade is connected to at least one port on each unit and provides in effect a 
communication ring by means of which a packet which leaves a unit by way of a port (termed 
a cascade port) connected to the ring can reach all the other units by way of the ring. Cascades 
normally include a variety of control mechanisms which enable a given unit to determine the 
unit by which a packet was placed on the cascade, mechanisms to prevent circulation of 
packets continuously on the ring and so on. Cascades are known in a variety of forms. 
Examples are: 

Trunkin g 

A further known feature in network practice relevant to the invention is 'trunking', which is 
described in for example WO99/29072 and GB-2333429 The term is used to describe a 
communication link which essentially comprises a multiplicity of links from a device or 
group of devices to another device or group. In its simplest form it is constituted by a 
multiplicity of links each to a respective port on a single unit from a single source entity; a 
typical feature is that traffic intended for a particular destination may arrive at any of the links 
constituting the trunk. Trunking is known to be useful in order to increase the bandwidth 
available for traffic from a particular source or going to a particular destination. 

It is generally desirable in order to provide appropriate versatility in network connections, to 
allow the connection of the links constituting the trunk to different ports not only on the same 
network unit such as a switch but also to pons on different units of a stack Such a trunk may 
be termed a stack-wide trunk . It is not necessary for all the units in a stack to have a port 
which is a •member" of the trunk Our recent patent applications numbers 0004517.9 filed 28 
February 2000 and 0010032.1 filed 26 April 2000 describe various proposals for the specific 



management and control of stack-wide trunks that may be required to follow particul; 
forward inu rules. 



Suniniiii v of the Invention 



The present invention relates specifically to a problem arising from excessive flooding of 
packets containing •unknown' unicast destination MAC addresses. When network switches 
are stacked together, it is normal practice to Hood such addresses out on all pons of the stack. 
Thus if a given unit in the stack receives on one of its pons a packet of which the destination 
MAC address is not the subject of an entry in its forwarding database, the unit will not only- 
flood that packet out on all the pons (or at least all those pons for which such flooding is 
possible or enabled) but will also place the packet on the cascade so that the packet reaches all 
the other units in the stack so as to be flooded from all the relevant pons. Although this 
flooding causes a temporary and inevitable degradation in bandwidth and performance of the 
network, eventually a response from the destination MAC address in question will cause that 
address to be learned', that is to say made the subject of an entry in the forwarding database 
of all the units in the stack Then whether a unit receives a packet containing that specific 
destination MAC address by way of one of its pons directly or by way of the cascade, no 
flooding will occur subsequently while the destination MAC address remains in the database. 
However, in a network system where there is a stack-wide trunk, a response from a remote 
device which would resolve that unknown destination address will be sent to one of the units 
in the stack but need not necessarily reach all the other units of the stack. More particularly, 
the response which would enable resolution of the unknown destination MAC address may be 
sent by the receiving unit back along the trunk by way of a different link to that on which the 
packet was originally received. 

This problem can be alleviated at present by means of separate flagged storage of unknown 
unicast destination MAC addresses. More particularly, if a unit receives an unknown unicast 
destination MAC address. .. will save the destination MAC address in a distinctive manner. 



for example in a separate area in memory or with a special flag. The stack of units may be 
controlled by stack-wide software, which polls each unit to determine whether any of the 
units have received any unknown unicast MAC addresses and has recourse to the forwarding 
databases of all t he units to resolve the unknown unicast destination MAC addresses for all 
the units However, such a solution is generally slow and is limited by the size of the storage 
available and the speed at which the software can be permitted to poll all units on the stack. 
More particularly pollmy of units will require bandwidth on the cascade which is then not 
available for ordinary traffic How. 

The present invention is based on the transmission of a packet which has an unknown unicast 
MAC destination address on the cascade with a flag, which may be constituted by a single bit, 
to indicate that the destination address is unknown. Such a flag may be constituted by 
otherwise redundant field space in the header of the packet, for example a VLAN tag header 
as described later. All the units on the cascade will receive the flagged packet and if any unit 
already has that MAC address in its database, it will produce a management frame which is 
sent on the cascade indicating to the other units of the stack the location of the unknown 
MAC address This allows all units on the stack to learn' that destination MAC address, i.e. 
make it the subject of an entry in its forwarding database, the entry including appropriate 
forwarding data for that destination address 

Further features of the invention will be apparent from the following description with respect 
to the accompanying drawings. 

Brief Description of the Drawings 



Figure 1 illustrates a switch having a multiplicity of ports for receiving and forwarding data 
packets and other generally conventional features. 



Figure 2 illustrates a stack of units connected by a cascade and having a trunk connection to 
some of the units in the stack. 

Figure 3 illustrates an operational phase of the stack shown in Figure 2. 
Figure 4 illustrates another phase of operation of the stack. 
Figure 5 is a further phase of operation of the stack 

Figure 6 is a flow diagram illustrating the production of a flag for an unknown unicast packet. 

Figure 7 is a flow diagram illustrating the operation of units which receive a flagged packet. 

Figure 8 illustrates an Ethernet packet in a typical form 

Figure 9 illustrates a method of flagging such a packet. 

Figure 10 illustrates a specific routine for placing a flag on a packet. 

Figure 1 I illustrates the response of a unit to a special management packet 

Figure 12 schematically illustrates a special management packet. 

Detailed Description 

Figure 1 illustrates in a deliberately simplified way a multi-port switch for a packet-based 
data communication system. The switch 10 may in general have a substantial number of 
pons, such as twenty-four or even many more, but in the present example is shown as having 
four pons 1, 2, 3 and 4. Each of these pons is associated with a 'Port ASIC la - 4a 
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respectively. These port ASICs provide the customary processing of packets after they have 
received and before they are subject to the look-up and forwarding process. Very typically, 
the port ASICs may be constituted on a single integrated circuit along with most of the other 
components of the switch, with the possible exception of some of the memory 5, but it is not 
intended to limit the present invention to any particular hardware implementation or 
configuration. Generally, packets received by any of the ports may, after temporary storage in 
FIFOs schematically represented as lb to 4b for each of the ports, will be stored in memory 5 
while address data in the packets is examined to find matches of destination addresses in a 
forwarding database 6. As previously mentioned, this type of forwarding database may be 
compiled by an examination of source MAC addresses in incoming packets in a manner 
which is well known in the art. The switch has a bus system 7, shown as a single bus line 
merely for convenience, and a switching engine S associated with a look-up engine 9. These 
may be constituted by a single software or hardware controlled entity which has recourse to 
the forwarding database 6 as well as providing control of the memory 5. Again, as is well 
known in the art. the look-up engine 9 (called herein 'forwarding engine') will perform look- 
ups in the forwarding database 6 and the combined entity of switching engine 8 and look-up 
engine 9 will cause entries in the database as well as retrieval of packets from memory 5 so 
that packets can be forwarded to the port or ports indicated by the nature of the address data. 
For the sake of completeness the switch 10 is shown as including registers 1 1 which store 
configuration data for the switching and look-up engines 

It is known to insert entries in a forwarding database such as database 6 by means of external 
control exerted by management packets. This may be necessary when initially configuring the 
switch or for other purposes. 

Figure 2 illustrates one form of stack-wide trunk to which the invention particularly relates. In 
this example there are four switch units, denoted Unit I to Unit 4, which are connected by- 
way of a cascade 20 which may be in any of the forms previously described. There is a 
remote device A, which is connected to the stack by means of two communication links 21 



and 22 constituting a trunk. By this is meant that the device 20 may provide traffic to the 
stack on either of the links constituting the trunk and may receive traffic on either of the two 
members of the trunk 

Figure 2 illustrates a specific circumstance wherein device A, having a MAC address A, is 
connected to switch 20 and is intending to communicate with device B having MAC address 
B. It is supposed for the sake of example that packets sent from device A to device B proceed 
on member 21 of the trunk whereas packets from device B to device A proceed from Unit 4 
towards device B on link 22. 

When packets for device B are first received on Unit 1, that unit does not have the MAC 
address of device B in its forwarding database. Accordingly, the packet is 'flooded' to all 
pons on the stack That is to say the packet is sent out by way of all appropriate or enabled 
pons on Unit 1 as well as on the cascade pon connected to cascade 20 so that the packet 
reaches all the other units in the stack. 

When device B eventually responds to device A, the response is sent back on a different link- 
on the trunk. This may happen fortuitously, though it is known to have a forwarding rule 
known as a local forwarding rule' wherein a given unit on a stack on receiving a packet 
intended for the trunk will forward such a packet directly to the trunk. 

If this occurs, the traffic pattern will prevent the receiving Unit 1 from ever learning the 
destination of the original unknown MAC address via the ARP response. The unknown MAC 
address may be learned by a polling routine as described previously, but the present invention 
is intended to provide a technique which improves on that polling process. 

Figure 3 illustrates the first phase in the present solution to the problem. When packets arrive 
at Unit 1 from device A, destined for device B and if Unit 1 does not yet have that destination 
MAC address B in us forwarding database, then, as before, the packet will be flooded to all 



relevant pons in the stack. However, when sending the packet down the cascade it also sends 
a flag, herein called unknown unicast DA flag' with the packet indicating that the 
destination MAC address of the packet was unknown when it was received by unit 1. A 
possible way of inserting this flag is described later All units on the cascade receive the 
5 packet and check the status of the flag. If any unit already has in its database the MAC 

destination address of B. and the unknown unicast DA flag is set then it must take action. 

Figure 3 indicates that Unit 4 is the unit which will take action because it has device B 
connected to one of its local pons In accordance with the invention and as shown in Figure 4, 
|o Unit 4 will send a special management packet back up the cascade indicating (in a manner 

described later) to the other units in the stack that it has the relevant forwarding data for that 
unknown MAC address. This allows all units on the stack to learn the location of that MAC 
address Thus there is no longer a need to flood packets to all units on the stack. 

is Figure 5 illustrates the subsequent phase wherein packets received by Unit 1 by way of the 

trunk from device A and intended for device B will be sent only by way of the cascade to 
device B. 

Figure 6 is a flow diagram showing the initial phase Unit 1 will perform a look-up. stage 60, 
2o in its forwarding database to determine (stage 61 ) whether the destination address of a packet 

is known. If the destination address is not known then the unknown unicast DA bit will be 
sent down the cascade with the packet (stage 62). 

Figure 7 illustrates the operation of the receiving units (i.e. Units 2 to 4 in this example). They 
25 parse a received packet (stage 71). If there is detection of an unknown unicast destination 

address (stage 72), the relevant forwarding engine will determine (stage 73) whether the 
destination address is known locally (i.e. whether it is in the database of the receiving unit). If 
it is known, then this unit will construct (stage 74) a management packet to respond with 
destination of unknown destination address. 
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Figure 8 is a diagram of an Ethernet data packet 80. The header includes a 48-bit destination 
address (DA) and a 48-bit source address (SA) The packet may include network (layer 3) 
address data but for simplicity this address data is not shown and may be regarded as included 
within the 'data-. It is customary for packets of this nature to contain a 16-bit VLAN 
identification field included in the packet header and normally containing a priority field, a 
CFI bit and a 'VLAN ID'. It is also customary for such a VLAN identification field to be 
preceded by a VLAN tag header, known as the 8100 field 

It is poss.ble to utilise the tag header field to convey information within a system such as a 
stack of units because the tag header field is redundant while the packet remains within the 
system. The 16-bit tag header field may be modified so that, for example, as shown by the 
packet 90 in Figure 9. the field contains a first bit, a tag present" bit indicat.ng that the 
original packet had a VLAN identification field and 15 bits which may be used for selected 
information, such as the unknown destination address flag' previously mentioned. 

Figure 10 illustrates a process by which the VLAN tag header is substituted. The process has 
two branches, depending on whether the packet entering the stack contained a VLAN 
identification field or not From a start stage (101) which depends on stage 62 of Figure 6, 
there is a determination (stage 102) whether the packet is already tagged, that is to say has a 
VLAN identification field If the packet is already tagged, then stage 103 is performed, this 
stage consisting of replacing the most significant 16 bits of the VLAN tag with the user 
defined information. The most significant b.t (bit 3 1 ) is set to * 1' to indicate that the packet 
came with the VLAN tag and so the last 16 bus constitute a valid tag. Bits 30-16 may include 
(for the sake of an example) an identificat.on number for the trunk, an identification number 
for the originating unit, such as Unit 1, and the 'unknown destination address flag'. The 
remaining bits, bits 15-0, are unchanged. 

If the packet were not already tagged, then stage 104 is performed. This requires the insertion 
of 32 bits into the packet in the position that would normally be occupied by a VLAN tag. 



The most significant bit. bit 3 1. would be set to zero to indicate that the packet did not come 
in with the VLAN tag Bits 30-16 are determined in the same way as bits 30-16 in stage 103. 
The remaining bits, bits 15-0. which would normally contain the VLAN ID, CFI and priority 
bits for the packet may be set to some default values. 

Whichever of the stages 103 or 104 is performed, the packet is transmitted down the cascade. 
When the packet ultimately leaves the stack of units, the most significant bit of the substituted 
VLAN header tag will determine whether the ordinary tag field (as shown in Figure 8) is to be 
re-inserted or the whole 32 bits of the VLAN tag are to be removed from the packet before it 
finally leaves the system constituted by the stack of units. 

Figure 1 1 illustrates the process performed in a unit in response to a special management 
packet received on its cascade port (or one of its cascade pons if more than one is connected 
to the cascade). 

From a start stage 111, there is a determination whether a special management packet has 
been received on the cascade port. This stage (stage 112) and the next stage may be 
performed by a MAC device within the relevant port ASIC (see Figure 1). Stage 113 
indicates that if the special management packet is detected, it is parsed for the MAC address 
defined within it, as well as (preferably) a VLAN identification as well as a "box ID' field. 
The latter is an identification of the unit which has originated the special management packet. 

The parsing of the packet provides commands for (as shown by stage 1 14) the relevant fields 
can be entered into the forwarding database. The forwarding data for that destination address 
is preferably the cascade port on which the management packet was received. In this way 
when, for example. Unit 1 is shown in Figure 5 receives a subsequent packet having the 
previously unknown destination MAC address, it will have sufficient forwarding data 
associated with the entry in the forwarding database to be able to forward such a packet only 
to the cascade, as shown in Figure 5. 



Figure 12 illustrates for the sake of completeness a typical management packet of the kind 
which can be employed in the present invention. The packet 120 (ignoring such conventional 
features as a preamble or start of frame, includes an SKIP field denoting that the packet is a 
5 special management packet which should be parsed according to stage 1 1 3 to develop the 

commands relative to stage 1 14, the relevant MAC address 1 12, the VLAN ID 123, the 'box 
ID' 124 and a cyclic redundancy code 125. 

The MAC address will be entered in the unit's database along with the forwarding data, 
10 which may be the cascade port or the 'box ID' or both depending on the organisation of the 

unit's forwarding engine. Provided that the forwarding data ensures that (for example) a 
unicast packet for device B received by Unit 1 is now directed only to Unit 4 by way of the 
cascade the particular mechanism is not important 



2D 



Claims 



1. A method of operating a stack of multi-port network communication units each of which 
has a forwarding database, the units being connected by way of a cascade, and at least some 
of the units being connected to links constituting a trunk, the method comprising: 

receiving by way of the trunk a unicast data packet at a first of said units; 

sending, when said unicast data packet has a destination address which is not the subject of an 
entry in the forwarding database of the first unit, said unicast data packet by way of the 
cascade to the other units in the stack, accompanied by a flag denoting the absence of said 
entry; 

sending, for a second unit in the stack, when said second unit has an entry in its forwarding 
database, associating said destination address with forwarding data, a management packet 
indicating said destination address and the identity of said second unit; and 

in response to said management packet, making in the forwarding database of said first unit 
an entry relating the said destination address and said identity of said second unit. 

2. A method according to claim 1 wherein the flag comprises a field in a header of the 
unicast packet as it is sent on the casacade. 

3. A method according to claim 1 or claim 2 wherein said address is a media access control 
(MAC) address. 

4. A multiport network switch for data packets which include media access control addresses, 
the switch including a forwarding database for relating destination MAC addresses to 
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respective forwarding data, the switch being operable in a stack of units connected by a 
cascade, said switch having a forwarding engine, said forwarding engine being operative: 

(i) on reception of a data packet having a destination address which is not the subject of an 
entry in said database to forward said packet to the cascade with a flag denoting the absence 
of said entry; 

(ii) on reception of a data packet which is flagged to denote the absence of such an entry in 
the database of another unit to send, if such an entry is in the units' database, a management 
packet containing the destination address and an identification of the unit; and 

(ii.) in response to receipt of such a management packet from another unit, to make in the 
forwarding database an entry relating the destination address and the respective identification. 
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